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ABSTRACT 

Procedures and guidelines for use by visitation teams 
were developed and field tested to determine appropriate activities 
for such teams in the evaluation of vocational education programs in 
Virginia^ and to expand and improve the annual local evaluation as a 
self-evaluation procedure. A review of the li teratura was conducted 
to determine the state-of-the-art from which preliminary guides were 
developed for conducting onsite evaluations. The annual local 
evaluation guidelines were revised and distributed to all school 
divisions. The major portion of the report consists of appendixes 
which contain the project-developed literature review for onsite 
evaluation^ the general outline of activities for visitation team 
evaluation^ the visitation team interview guide^ and the annual local 
evaluation procedures^ forms^ and guidelines. (NJ) 
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Vocational Education Program Evaluation Proiect 

Summaiy 

« 

The Division of Vocational Education, State Department of Education 
(DVE/SDE) fimded the project, based in the Division of Vocational and 
Technical Education, Virginia Polytechnic Institute and State University for 
the period July 1, 1975 to June 30, 1976. 

Objectives 

The objectives of this project were (1) determine through a state-of-the- 
art study the current approaches to the use of visitation teaiiis ; (2) to 
develop and field test the procedures and guidelines for use of visitation 
teams in Virginia; and (3) to continue to expand and improve the Annual Local 
Evaluation as a self-evaluation procedure. 

Procedures 



A state-of-the-art study was conducted through a review of the literature 
to determine the current approaches to the use of visitation teams. From the 
study, preliminary sets of procedures and interview guides were developed. 
No field test was conducted as a part of this project since DVE/SDE made 
available funds beginning with FY77 to support projects within school divisions 
which would, in effect, field test the materials developed by this project » 
The procedural booklet and guidelines for the Annual Local Evluation were 
revised, printed, and distributed in sufficient quantities to all school 
divisions . 

Project Staff 

The project director was the only professional staff member. A half-time 
clerk-typist was hired at the beginning in May to complete the project. 



ResulLs an d Accoinpllshments 

A review of the literature was conducted in orcic^.r to detenriiiie the 
state-of-the-art froin whidi preli^iinary guides werf^ dewloped for conducting 
an on-site evaluation. The Annual Loc^:. Evaluation guideline.? were revised 
to more closely conform to the major goals of VDca>.-.iona.l education as set 
forth by tne DVE/^DE. 

Evalrj at ion 

Ko third party evaluation was required. 'llie staff of the Divisions of 
Vocational Education and Educational Research and Statistics, State Depavtment 
of Education, provided continuous evaluation. 

Conclusions and Recoimnendati ons 

1» The Annual Local Evaluation is providing a workable procedure for 
local school divisions to conduct an annual self-evaiua'.ion of the 
vocational education prograins. This system should be continually 
evaluated in order to iniprove its effectiveness. 

2. Only ' Tiieager beginning was made to devolop the procedures necessary 
to conduct an on-site evaluation by use of a visitatio.i team due to 
a change from the use of the Annual Local EvaluatiGn as the basic 
self-study to procedures used by the Southern Association. Considerable 
work is yet required to , fully operationaliee these procedures. 
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THE PROBLEM 



School divisions of the Com-Donwealth of Virginia are required to revise 
;;nd update annually the five-year school improvement plan. Systematic program 
evaluation in the foundation upon which program planning is built. Local 
self-evaluation at\d use of a visitation team are the major components of a 
sysi-ematic program evaluation, 'fhe basic procedures for conducting a systematic 
local self-evaluation have been developed. This research project was concerned 
with determining the appropriate activities of a visitation team and developing 
related guidelines. 

BACKGROUND INFOR>iATI0N 

Initial work on developing a systematic local evaluation procedure began 
in January 1573. A seif-eveiuation procedure was develope-d and field tested 
in four school divisions in the spring of 1973. Revisions were made based on 
the field test and reconanendations of such groups as the DVE/SDE staff and ' 
local directors of vocational education. Statewide implementation of the revised 
procedure - Annual Local Evaluation - took place in April 197A on an optional 
basis. Sixty-eight school divisions evaluated their vocational education 
programs or a portion thereof, during the spring of 1974 using the Annual 
Local Evaluation procedures. The results and experiences from these school 
divisions served as the basis for another revision and some expansion of the 
evaluation procedure. All school divisions in Virginia have been requested 
to incorporate the Annual Local Evaluation procedure into their evaluation 
of the vocational education programs in the spring of 1975. 

Self-evaluation as outlined in the Annual Local Evaluation provides for 
teachers and supervisors to have direct input into the evaluation process. 
Students, former students, employees, and other lay persons of the community 



participate actively by serving as meinbers of advisory committees. Self- 
evaluation provides through self-study an inward look at the vocational 
programs. The information and recommendations resulting from the self-evaluation 
should be reviewed by persons not directly involved with the vocational 
education program. This review by a visitation team will verify the self- 
evaluation and provide additional data and recommendations to the school 
division for use in planning the vocational education program. 

OBJECTIVES 
The objectives of this research were: 

1. to determine through a state-of-the-art study the current approaches 
to the use of visitation teams. 

2. to develop and field test the procedures and guidelines for use of 
visitation teams in Virginia. 

3. to continue to expand and improve the Annual Local Evaluation as a 
self-evaluation procedure. 

PROCEDURES 

A state-of--the-art study was made to determine current approaches to the 
use of visita' on teams. Information gained from this study provided the 
basis for the development of a preliminary set of procedures and guidelines 
for Virginia. 

► 

The Annual Local Evaluation guidelines were revised based on feedback 
from the DVE/SDE. After revision the booklet was printed and distributed 
in sufficient quantities to all school divisions. 

PROJECT STAFF 

Dr. Donald E. Elspn, project director, was the only professional staff 
member. A clerk-typist (1/2 time) was hired at the beginning of May to 
provide necessary secretarial assistance. 



Qualifications of Project Director 
Education: 

Ph.D. - Michigan State University, 1972. (Major: Vocational Education; 

>tLnor: Administration and Higher Education; Cognate: Research 
and Evaluation) 

M.S. - Kansas State University, 1968. (Major: Agricultural Education) 
B.S. - Kansas State University, 1958. (Major: Agricultural Education) 
Experience : 

Currently Assistant Professor ar. i Coordinator of curriculum and program 
evaluation in the Division of Vocational Education, Virginia Polytechnic 
Institute and State University. Principal developer of the Annual Local 
Evaluation procedure. 

RESULTS AND ACCOMPLISHMENTS 

A review of the literature was conducted in order to determine the 
state-of-the-art. Research reports and evaluation documents from states were 
revieweu.. A copy of the report is included as Appendix A of this report. 

After completing the state-of-the-art study, a set of preliminary 
procedures and guidelines were developed. The basis of these procedures was 
the use of the Annual Local Evaluation as the self-study. DVE/SDE personnel, 
after study of these procedures decided that the visitation approach should 
be more in line v;ith the approach used by the Southern Association for accred- 
itation purposes. As a result, considerable work is yet to be done to develop 
an on-site evaluation procedure for vocational education which will conform 
to thepe procedures used by the Southern Association. No field test was conducted. 
The DVE/SDE has made money available through exemplary funds to assist school 
divisions in conducting an on-site evaluation for the fall of 1976, This will 
provide a field test of the work of this project. 
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EVALUATION 



No third party evaluation was required. The staff of the Divisions of 
Vocational Education and Educational Research and Statistical, State Department 
of Education, provided continuous evaluation. 

CONCLUSIONS AND RECOMMENDATIONS 

1. The Annual Local Evaluation is providing a workable procedure for local 
school divisions to conduct an annual self-evaluation of the vocational 
education programs. This system should be continually evaluated in 
order to improve its effectiveness. 

2. Only a meager beginning was made to develop the procedures necessary 
to conduct an on-site evaluation by use of a visitation team due to 
a change from the use of the Annual Local Evaluation as the basic 
self-study . to procedures used by the Southern Association. 
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Appendix A 

Procedures for On-Site Evaluation 
State-of^-the-Art 



I 
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Procedures for On-Site Evaluation 



A State-of-the-Art Study 



by 



Donald E. Elson, Ph.D. 
Division of Vocational and Technical Education 
Virginia Polytechnic Institute and State University 
Blacksburg, Virginia 24061 



1976 
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Procedures for On-Site Evaluation 
A State-of-the-Art Study 

Rationale for On-site Visitation 

The question can be asked,, who should evaluate? Tl\e answer to this 
question has implications for visitation teams. Proponen.ts of visitation 
teams claim that someone outside the organization can see problems in a new 
light and aiay be able to suggest solutions not seen by those working day-to- 
day with the problems. Opponents suggest that outsiders may not have 
sufficient insight into the reality of the problems and, therefore, could 
antagonize school personnel (Byniside, 1969), 

Verification of information provided by the self-evaluation report 
and presentation of additional information seem to be two major reasons for 
the use of visitation teams. Ash (1971:20) adds to this rationale by 
stating thai: the purpose of a visitation team is . . to evaluate the 
institution's systems for conducting valid self-evaluation, to verify the 
extent to which outcomes correspond with need and with stated objectives, 
and to. supplement the Self-evaluation Report with additional data and 
documentation where needed." Tlie Illinois Office of Education (1975b: C) 
indicates that the purpose of the va.sitation team is , . to provide a local 
district with. a profile of its total occupational program . . 

Visitation teams for on-site evaluation of vocational education programs 
have been used in Tennessee since 1971. These procedures have, . . . proven 
to be time-consuming and financially burdensome." (Wallace, 1975:iii) An 
indepth study was initiated to evaluate the procedures and make recommendations 
for future evaluation of vocational programs. Wallace (1975) presented the 
following conclusions as a result of the study in Tennessee: 

1. Information obtained from currently used instruments for. on-site 

evaluations by visiting teams was not adequate to be able to deter- 
mine relative quality of vocational-technical programs. 

11 



2. Currently used state evaluation instruments were not definitive or 
specific enough to identify the same quality aspects of vocational- 
technical prograius as did the Ray Self-Checklist evaluation instru^ 
ment. 

3. Professional vocaticnalTtechnical educators could not analyze team 
visit reports and adequately deteruiine the quality of ^selected 
vocational-technical programs. State evaluation procedures need 
to include checklists where more observations could be made, 

>4. Guidance counselors were less able to identify elements of quality 
vocational-technical progra^ns than were teachers or principals. 

5^ Some of the elements on the Ray Self-Checklist overlapped in their 
interpretation. 

6. A panel of experts, linfamiliar with each individual situation and 
trying to glean information from an on-site team report, was not 
able to identify outstanding elements of quality vocational programs 
as easily as the professionals who were closest to the situation. 

The major recommendation made by the Wallace study was that instruments 

should include more quality indicators and should be objective in nature. 

(1975:12) 

Selection of Team Members 

The selection of the team leader is of critical importance. The individual 
selected as team leader should have experience in vocational education and be 
familiar with the total vocational program, understand the needs of various 
size schools, and be a competent leader. (Illinois, 1975a) 

The team members should rtspresent each vocational area for which prepara- 
tion is offered, plus, students, administrators, guidance, and other specialized 
areas related to the vocational program^ (Ash; Illinois; National Study). The 
number of individuals on the team varies with **. . . the size of the school, 
the number of days that will be available for the visit, the amount of 
experience of visitors, the interest in using the visit as a phase of in-service 
education, and the willingness of the visitors to work long hours/* (National 
Study) ,The selection of the team members should be a joint effort between 
the school and the evaluating agency. 
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Tlic Visic 

The most important concept to be kept" in aiind by the visiting team and 
all individuals in the school is tha> the team is not at the school to find 
fault, but to verify and supplement facts. 

Each set of procedures reviewed relied upon a set of guidelines to 
direct the activities of the visitation team. (Ash; West Virginia; IllinoiR 
1975 a and b; National Study; Tennessee) While these guidelines varied in 
complexity, all attenpted to elicit data and information for making well 
informed decisions and recommendations. 

Summary Conference 

Tl-.e "summarj' conference" between the team and school personnel was 
deemed important especially by the Illinois, Office of Education. The purpose 
of this conference is tP communicate the team's findings to the school 
personnel. This meeting also provides an opportunity for the administrators 
of the school to make known any limitations they may see which would hin'der 

t 

the implementation o,' the recommendations made by the visitatior team. 
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Appendix B 

General Outli.ie of Activities 
for 

Visitation Team Evaluation 



'■^ j General Outline of Activities for Visitation Team Evaluation 



1. September 15, 1976. All school personnel involved with vocational education 
will review the 1976 Annual Local Evaluation Report as submitted to the 
Division of Vocatioiial EducaJ:ion. 

Mutual agreement will be reached between the project director and the Division 
of Vocational Education as to the persons to be named as members of the 
visitation team. 

2. September 15 t l,er 15, 1976. ThreeH w<.rkshop for the team members 

^ personnel from VPI & and/or the IMvision of Vocational 



will 1 
EdvK 



Project director will complete or havo completed the following: 

a. Division Information form • project director 

b. Instructor Information form • all personnel involved with vocational 
education 

c. Student Information form - all students enrolled in a vocational course. 

3. October 15, 1976. .Project director will provide members of the visitation 
team with copies of the 1976 Annual Local Evaluation Report, the current 
Annual and Five-Year Plan for Vocational Educai-'on, summarie.s of Lae three 
forms listed above, and other data and inform m which will assist tne 
team. 

4. OctobG ^5 to November .5. 1976. Conduct thr ay on-site evaluation by 
visitc^i n. Report viil be prepared and revit . with school personnel du: xn.;: 
last c : "3 moon of visit. 

5. Decemr : 15, 1976. Final copy of visitation rt il prepared by project 
direct and submitted to team leader for his proval. Six copies sent 
to the Division of Vocational Education. 

Visitation Team Int erview Guide will be used by team members to study vocational 
education in division and as a guide as they interview individuals during the 
visit to the school. Reference data are obtained from the Annual Local Evaluation 
1976 Repor-, the Division Information form (D) , the Instructor Information form 
(I), and the Student Information form (S) . 
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VISITATION TEAM 
INTERVIEW GUIDE 
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Major Goal I 

Youths and adults will acquire the skills and knowledge needed for initial 
and continuing employment or self-^pioyment in occupations of their choice 
and for which there are employment opportunities and they will also acquire 
the competencies needed as consuemrs of goods and services, for home and 
family living, and for personal use. 

Ob.jectives of Interview : 

1. Determine how many of the five occupational areas are available to students 
and "determine the effectiveness of each area. ' 

2. Determine whether the occupational courses are sequentially structured into 
occupational programs. 

3. Determine if measurable objectives exist for (a) total program, (b) indi- 
vidual programs, and (c) specific courses. 

A. Determine the criteria used to identify disadvantaged and handicapped 
Students. 

5. n^nermine what additional services are being provided for the. disadvantaged 
and handicapped students. 

6. Determine what provisions are mader-to insure that students are employable 
by the time they terminate their formal education either by graduating or 
dropping out. 

7. Determine how knowledgeable students are about the purposes, objectives 

......^^'L'^':!:^^^^^^ 

onroilcd. - 

8. Determine whether the occupational programs offered students adequately 
prepare them for employment. 

9. Determine if the training needs of adults in the conmunity are being met. 
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Refer erice Data ; 

1. Guidelines for Annual Local Evaluation, Part B, Sections 1 and 2, 1976 report 

2. (1-11) Are the occupational courses sequentially structured into a program? 



Yes No 



3, (1-12) Are there stated and measurable objectives for: 

a. the division's total occupational program 

No Not sure 

b. the program (s) in which you teach, administer, or provide guidance 
Yes ____ Uo 

c. the course(s) wr-ch you teach, administer, or provide guidance 
Yes No ____ Some 

4. (1-13) Are you familiar with your institution's plan for identifying 
disadvantaged and handicapped students? 

Yes ^ No 

3. (1-14) ..re additiona, serv^ices provided for disadvantaged and handicapped 
students? (other than special education) 
Yes No Not sure 

6. (S-10) Do you feel your ^instructor (s) have clearly explained the objective 
and goals of your occupational course (s)? 

Yes No 

7. (S-12) Rate your program in terms of preparation for an occupation. 
Ui^h • Average Low 

^^"-^^ ^"^^^"^-y-^^-^^^^^ 

a riend? 

Yes No 
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9- (S-IA) Do you expect to: 

^ a job doing what you are learning? 

^ get a job similar to the one you are learning? 

continue studying about the same job at another school after gr- Uiat 

make little use of what you are 1 

'^oulci you like to change to another occupational program? 

Yes ii^o 



11* (S-16) Is your preferred -rograra available? 
Yes No 

12. (S-i7) Is it possible to -hange programs if you want to? 
Yes No 

13. (D-6) what percentage of .oar student population is enrolled in occupational 
education? 

14. (D-.7) Refer to enrolLnent t^^le (item 7) on Division Information form. 
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Major Goal II 

Youth and adults will become aware of employment or - .-employr op- 
portunities and requirements : 4SC ... lakin^ career choice and in oe.etruinin^ 
Lheir education programs. 

Objectives of Interview ; 

1. Determine the availability an. quUity of tr K-8 occupational information 
program. 

2'. Determine whether the content of occupational orientation courses (9th 

and 10th grades) is appropriate for that level. 
3. Determine if program and course objectives are communicated to students. 
4.. Determine who is involved in providing occupational guidance services to 

students (instructional staff, guidance personnel, etc.). 
5. Determine the extent of the following services provided to students: 

a. Availability of current career information materials (guidance office, 
library, ecc), 

b. Formal ^-lacament service (full time or part time employment and 
advanced training). 
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Reference Data 

1. Guidelines for Annual Local Evaluation, Part B, Sections 1 and 2, 1976 report. 
2- (S-11) Do your current occupational courses relate to your chosen career 
goals? 

Yes No Somewhat 



3, (S-9) Are you aware of occupational program and course objectives? 
Yes No 

4, , (S-4) Last year I met with a counselor I 
niore than 5 times once 

4-5 times 



never 

2-3 times 



5; (S-5) I would rate my counselor's knowledge of the world of work as: 

'■ — '^^8^ Below average 

, Average X don't know 



V 



l6. (S-6) I would rate the iuformation I have received from counselors with 
regard to my future occupation as : 

H igh _3ome None 

7. (S^7) Outside of your own personal interest, who encouraged you the most 
to enroll in the occupational program you are now taking? 

Instructor or admir.iz- irator r::.rent 

Guidance counselor None of these 

, Friend 

division provide pljacement services fori 

a. Enrolled students Yes No 

b. Dropouts Yes No 

c. Graduates Yes No 
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Kajor ^ Goal III 

Youths arid adults will exhibit pride in work well done; confidence in ability 
to perforin in the world of work; and develop leadership abilities, responsible 
i citizenship, and a realistic self- image in relation to work in their chosen 
vocation. ^ - 

Pbj:.ctives of Interview ; 

1. Detn.rmine the scope, availability and effectiveness of youth organizations 
in serving students' needs and intereBts. 



/ 
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R eference Data 

1. Guidelines for Annual Local Evaluation, Part B, Section 1 and 2, 1976 report. 
(S-3) I am a member of a vocational student organization? 
do 

Yes, meets more than once a month 

. Yes, raeets once a month 

- Yes, meets 2 or 3 times a semester 

Yes , meets 2 or 3 times a year 

- Yes, meets less than 3 times a year 

3. (D-3) Membership in student organizations. 

FFA . 

FHA 

_ ' FBLA 

DECA . 

VICA 

HERO 

Other 
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Manor Goal IV 

Youth and adults will benefit from programs improved and expanded through 
ancillary activities, including teacher education., research, guidance, super- 
visioti, planning and evaluation. 



Objectives of Interview ; 
A. Research 



1. Determine procedures for assessing student needs, occupational interests 
and abilities and utilizing thia information. 
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Reference Data 

I 

1. Guidelines fbr Annual Local Evaluation, Part B, Section 1 and 2. 1976 report. 

2. ^^""l^) Do guidance personnel ^and instructors work together in identifying 
stud^nto' ileeds and interests. 

Extensively Little 

____ Moderately None 



3, 



(D-4) What is the current unemployment rate for your ax;ea? 



4. (D-5) What is the current youth unemployment rate for your area? 

5. (D-8) What was last school year's dropout rate "for all high school 
students? 

6. (D-9) \'Jhat is the administrator's estimate, by percentage, of graduates 
what enter: 

r 

J four year colleges 

_i two year post-secondary 

- o^'*^ year post-secondary certificate program 
private career school 

^ immediate job placement (exclusive of Armed Forces) 
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QbnectivGs of Interview ; 
B. Guidance 

1. Determine the involvement V)f guidance personnel in the following; 
a» Occupational advisory committees 

b. Identification of disadvantaged and handicapped students 

c. Participate in the conduct of formalized follow-up studies 

d. Evaluation of guidance services 

e. Development and operation of the K-S occupational information 
program. 

f. Conducting inscrvice programs to acquaint instructional staff 
with the guidance services available to students. 
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A Reference Data 

t 

;1. Guidelines for Annual Local Evaluation, Part B, Sections 1 and 2, 3976 report. 



28 



ERIC 



, Objectives of Interview ; 

i 

j C» Planning 

1. Determine who was involve^ in establishing the total occupational pro- 
gram objectives as stated in the Plan for Vocational Education. 

2. De.armine what relationship exists between (a) total program, (b) indi- 
vidual program, and [c) specific course objectives. 

3. Determine how often the (a) total program, a (b) individual program, 
and (c) course objectives are reviewed for possible revision. 

4. Determine if board, administration, advisory committees, students and 
staff members are knowledgeable about total program objectives. 

5. Determine the need for addition, expansion or deletion of occupational 
programs . 

6. Determine the extent , of articulation of occupational programs at all 
levels of education (elementary, secondary, post-secondary and 
adult). . , 

7. Determine the extent of the coordination of occupational programs, both 
within and between departments or divisions. 

8. Determine the working relationship among all department in conducting 
a total occupational program. 

9. Determine how effectively the'- following internal resources are utilized 
in planning, conducting and/or evaluating occupational programs: 

,a* Staff 

b. Students 

c. Financial resources 
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Objectives z:' -nterview ; (conti-^ufed) 
C. Plaani-5 

10, .^.-a- nu-^ how eff. e foil, ^ing ex: ^n^ resour.es are 

'-^^ ^ - in planning, cr :ing az.d evalua^g occupat:.anal programs: 

' -sory committees 
0 ^unity business and industrial perso: 

c -JTiunity business and industrial facil:ci : 

d. r vernmental and ci . : agencies (i.e., : .noi3 State Employment 

rvice, Chamber of Jiommerce, etc.). 

e. Joint agreements and contracts with other public and proprietary 
institutions. 
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1 Referenc- Pat 
1. Gui'-'rline 



ocal Evaluation, Part B action 1 and I, '.V'S report 
I 2, (I-IL) Ar^ : -^^ srj: d and it^easurable objecti' 3? 

i 

! 3. (1-16) Were ^ inv ad in planning and/or maz:-ng changes in yc local 

f r-aar plan fcr vocational ecucation? 

Litxle 

None 



Division one rr 

Exten£_ 
Modern 



(D-2) Do cit 
advisory comni. • 

Yes Nc 

If yes, is the 



.c; your community serve on occupational education 



one adr\ committee for all occupational areas? 

a separa: r C jrmittee for each area? 

both. 
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Objectives :f Interview : 
D. Evaluation 

!• Determine how programs and courses are measured st the:..: objectives 

(i.3., by whom, how frequently, etc.)» 

^. Derermine what activities are included in the ev.^.lu ..:_ion sy-tem being 
conducted by the division (i.e., student f ollow-tra . -aff evaluation, 
cost analysis, employer survey, facility assessmc etc.). 

3. Determine who is involved in conducting the evalu^. ion system (i.e., 
teachers, administrators, students, advisory coinini-z.:e members, etc.). 

4. Determine how evaluation results are used (i.e., course revision, program 
revision, modification of instruction, deletion or addition of prgrams, 
etc.). 
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Reie:- Data 

1. .uic^lines for Annual ^ocal : 'aluat:_ -art B, Sections 2, 1976 report. 

2. '.I- vr:...zh term .-scribe, -our e -iiu ..^on system for c re rional 



Fcrmal Inforrr.ai Zlzne 



- ^^^^^^ ha-ve a forriial follow-up program tha:. ;;ives a 
pict ire f 7our entire studer body 7 
Yes No 



Only occupational students: Yeg 



No 



4. (D-12) Do students have an opportunity to formally evalu^i-:. air oc- 
cupational courses and programs? 

Yes :;o 

5, Who receives a copy of the Annual Local Evaluation report con- 
ducted each spring? 
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^ectiv ;\terview : 

^-dml. 13 i: ; Organization 

. . ie: -._zr- uhe support •? cupatio: programs by administrators and 
cz.^ -bers. 

2. i. if the struczur. ^or adminis terming occupational programs is 

11. . and understooc • / all operating within the structure. 
-3. L -er— 3 if job descrip ns u . roles correspond with the administra- 



t:. 



4. D-uermia rha authority correlates with the responsibility at the 
various levels of administration. 

5. Determine the effectiveness of vertical and horizontal conmiunication 
winhin trie admini curative 5 ;;ructure. 



• 
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Reference Data 

!• Guidelines for Annual Local 
2* .1-20.' Rate your local ^a: 
High AveX'-^e 



ai rlon, Fart B, Sections 1 and 2, 1976 report • 
3 -Dport of oc : iTJation ^ ^ducaii: ... 
Low 



Major Goal V 

Instructional staff posses..--^ tne necest ar: professional and rechnical 
qualifications required to adm^niater and cc-:::zt the vocational program. 

Objectives of Intervie^^ ; 

1. Determine the general, qualifications of oc:-pational staff including: 

a. Education (pre-serv^ij:. =r\d lii-service) 

b. Teaching experience 

c. Work experience 

d. Knowledge of the Wcu ~f Wc^k" 

1. Determine if a formal sysc:en for prof essioz.-:.! staff d-ve,op-nH-:r exists 
which may include prGv:L3irn5^ for rhe :oilnv±zir: 

a. Periodic work experier ce 

b. Periodic in-service tr-ai.\ ing 

c. Participation in profes ^nal or :aiiir::.:.r...ons 

d. Contact with employers „ srudeni-T: 

e. Visitation to other di" ons wirr. siuni:.^ programs 

3. Determine the quality of wor^ relarior.sh^js between th. occupational 
staff and: 

a. Other occupational ^ria r~ -lember; 

b. Non-occupational su^ 

c. Guidance personnel 

d. Students 

e • Adminis urators 

f. Local Governing Board 

g. Community business and industrial :aexsc::,ael 

h. Advisoiry committee;. 
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*^ Reference Data 

1. Guidelines- for Annual Local Evaluation, Part B, Sections 1 and 2, 1976 report, 

2. (1-3) Highest earned degree o*f faculty: 

Less than Baccalaureate Advance Certificate 

Baccalaureate Doctorate 

Masters 



3. (1-4) Types of certificates held: 

. High school teaching Administrative 

_ Provisional vocational Counseling 

Supervisory None 

^. (I-.) How many years of experience in occupational education have you had? 

- 0-^ years 13-16 years 

— . years . 16 or more years 

9-12 years 

5. (1-6) How many years of occupational experience outside of education have 
you had? 

None 5_8 years 

Less than one year 9-12 years 

1-4 years More than 12 years 



6. (1-7: Are you presently a member of a professional organization related 
to your field? 



Yes No 



7. (I- 10) Are you currently involved in the leadership of a vocational youth 
organization. 
Yes No 



f 
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. (1-19) Rate the working relationship among occupational instructors 

across all occupational areas. 

, High Average Low 

. (1-21) Rate the working relationship between occupational instructors 

and the following groups. 

High Average Low 



Academic Instructors 


! 1 ■ 


Occupational, program administratora 




r 


Labor and management 
personnel in government, 
business, trade, etc. 




■ i 

\ 
1 

- i 
! 


State and Local Governmental 
agencies 




1 
i 



;-8) I would rate my instructor's knowledge of the world. of work 
High Average Low 
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Major Goal VI 

Students have the opportunity to develop the necessary understandings and 
competencies as prescribed in the'program objectives through the use of 
properly equipped classrooms, shops and laboratories. 



Objectives for Interview: 



1. Determine the extent to which a multi-media instructiofial approach is 
used. 

2. Determine if the shop and laboratory equipment are comparable to that 
used on-the-job. 

3. Determine if adequate facilities and equipmen-. are available so that all 
students have sufficient exposure to and use of the equipment. 
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Reference Data 



1. Gui ilines for An=iual Local 3valuacion, Parr. B, Sections 1 and 2, 1976 report. 
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DIVISION INFORMATION 
Legal Name and Number of your Division 



Do citizens from your community serve on occupational education advisory 

committees? Yes No 

a. If yes, is there: 

one advisory committee for all occupational areas. 

tion^r^'^ committee for eacJi area? (List - the separate occupa- 
V tional areas having adviaory committees and the average number 
of meetings per year for each. average number 

both 



Name of Organizations 
FFA (Future Farmers of America) 
FHA (Future Homemakers of America) 

FBLA (Future Business Leaders of America) o 
VICA (Vocational Industrial Clubs of America) 

(Distributive Education Club of Araerica)_ 

(Home Economics Related Occupations) 



DECA 
HERO 
Other 



V/hat is the current unemployment r^t. for your area?_ 

What is the current youth une mployment rate for your area?___ 

counted in more than one class.) ' ^ student is not 
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9t. Grade 



10th Grade 



11th Grade 



12th Grade 



Senior Intensified 



Continuing (Adult) 



b. Total number of students enrolled in cooperativ e education 

T> T* r» rr "i~ rs m c? ' 



programs 



What was last school year's dropoVit rate for all high school students?_ 
^^ter?^ Administration's estimate, by percentages, of graduates who 



a. 

b.. 

c. 
d. 



four years of collci?e 

two years post secondary (include all students coramiutcd to 
transferring to four y'2ai: programs) 

one year post-secondary certificate program 
private career school 

Immediate job placement (exclusive of Armed Forces) 



10. a. With the exception of cooperative education students, does your school 
provide placement services for: 

1. Enrolled students Yes {Jo 

2 . Dropouts Yes x No 



11, 



3- Graduates Yes No 



b. l.lio is responsible for placement and in which department is the place- 
ment ^service located? 

Does your school have a formal follow-up program that gives a picture of ' 
your entire student body? Yes No 

Only occupational students? Y^a No 

If yes to either of the above: 

a. How often are follow-up studies conducted? 



b. is responsible for coordinating the follow-Up study? 



c. Are the results of follow-up studies disseminated to the instructional 
staff? Yes No 



d. Additional comments; 



12. Do student,, formally evaluate 'their occupational courses and programs? 

No 



13. Who receives a 



copy of the Annual Local Evaluation conducted each spring? 
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INSTRUCTOR INFORMATION 

Personal Information 

1. Your present primary position 'is: 
a. instruction 

b. counseling (advising) 

c. administration 

2. If instruction, in which occupational area are you most involved? 
a. not in instruction 

b. industrial oriented 

. c. personal and public service 

d. health 

^ , e. business, marketing and management 

' f • agriculture 
8» cooperative education 



3. Your highest earned degree is: 

a. less than baccalaureate 

b. baccalaureate 

c. mas'ters 

advanced certificate 

e. doctorate 

4. The type of certificate you hold is: (Mark only one) 

< 

a. high school teaching 

b. provisional vocational 

c, supervisory 

^* administrative endorsement 

_ e. counseling 

____ f • ijione 
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How many years of experience in Occupational Education have you had? 

(Teaching, Guidance, Administration) 

a. 0-4 years 

b. 5-8 years 

^ c. 9-12 years 

d. 13-16 years 

e. 16 or more years 



How many years of occupational experience, outside of education have you 
had? 



a • none 

b. -^less than one year 

c. 1-4 years 

d. 5-8 years 



/ 

e. 9-12 years / 



f. more than 12 years 



Are^you presentaly a membei of a professional organization related to 

your field? 

. Yes . No 

The nature of your last in-service experience was: 
a. University course * 

. b. non-credit workshop (University or Business sponsored) 

. non-credit workshop (school sponsored) 

. cl* occupntlonnl cxpcrioncc 

c. other 

How long since your last occupational course, workshop, etc., other than 
local division meetings? 

^ a» less than one year 

■ b. one to two years 
. c. more than two years 



10. Are you currently involved in leadership of a vocational youth organization? 

" Yes No . 

Program Information 

11. Are the occupational courses sequentially structured into programs? 
Yes No 

12. Are there stated and measurable objectives for the division's total 
occupatioanl program? 

Yes ^ No Don' t know 

13. Are you familiar with your institution's plan for identifying disadvantaged 
and handicapped students? 

Yes No 

14. Are additional services provided for disadvantaged and hanr_c apped 
student£ other than special education) 

-3 No Not sure 

15. Which term describes your local division's evaluation system for occupational 
education? 

^» Formal - a district - wide evaluation system exists which pro- 
vides information for total program planning. 

b. Informal - unrelated evaluation processes. 

. c. None- no structured district - wide evaluation. 



16. Were you involved in planning and/or making changes in your local division's 
one and five year plan for vocational and technical education? 

Jilxtcnsively 

Moderately 

' Little 
None 
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17. Do guidance personnel and instructors work together in identifying students' 
needs and interests? 

a. Extensively ^ 

b. Moderately 

c. Little 

d. None 



18. Rate the guidance personnel's knowledge of occupational course and program 
offerings . 

a* High - veir~ knowledgeable 

b. Average - -ome knowledge 

c. Low - little knowledge 

19. _^3te the working relacionship among occupational instructors across all 
occupational areas. 

a. High cooperation 

. b. Average cooperation 

■ c. Low cooperation 

20. Rate your local board's support of occupational education. 

3- ' ^gh - strong support ^ 

b. Average - generally supportive 

c. Low - little support » 

21. Rate the working relarionshlp between occupational instructors and the 
following groups : 

A. Academic Instructors 

^* High - most cooperate 

Average ~ some cooperate 

• c. Low - few cooperate 
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Rate the working relationship between occupational instructors and the ' 
following groups: (continued) 

B. Occupational Program Admir^istrators 

a. High cooperation . 

____b. Average cooperation 
^ c. Low cooper at Icn 

C. Labor and managemenr personnel in government, business, trade, commerce 
etc., in the commumry, 

a. High cooperation 

b. Average cooperation 

____ c. Low copper ation 

State and Local Government^il Agencies 

a. High cooperation 

_____ b. Average cooperation 
c. Low cooperation 
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STUDENT INTORMATION 

1. I am enrolled in: 

a» agriculture education 

business education 

distributive education 

d» health education 

consumer home economics 

f» occupational home econowipg 

trade and industrial education 

2. The grade I am in is: 

a. freshman (9th) 

. h. sophomore (10th) 

c. junior (11th) 

. cI* seni.r U2th; 

e. 13th (college) 

f • 14th (college) 

3. I am a member of a vocational student organization such as FFA, VICA, FHA, 
DECA, etc. 

a, no 

b. yes, meets more than once a month 

yes, meets once a month 

^* ye^» meets 2 or 3 times a semester 

yes, meets 2 or 3 times a year 

f- yes, maets less than three times a year 
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Last year I met with a counselor; 

I 

_I a. more than 5 times 

I 

^ b. 4 to 5 times ^ 

c. 2 or 3 times 

. d. once 

e. never 



I would rate my counselor's knowledge of the world of vcric: 

a. High - knows about most occupations 

b. Average - knows about some occupations 

c. Below average - knows very little about occupations 

d. I donVt know - never talked -bau:': oc -upat:.^;^^ 

I would rate the i .toriv.^cicn I have receivec from counselors with regard 
to my future occupation: 

a. liigh - consider -Die 

b. Average - some 

____ c. Low - little or none 

In addition to your own personal interest, who encouraged -ou the most to 
enroll in the occupation xl pragram you are now taking? (Mark only one) 

a. Instructor or -dmnistratoi* 

b* Guidance counselor • 

_____ c. Friend (s) 
, : d. Parent 

e. Uona of the above 



I would rate my instructor's knowledge of the world of work: 

— a. High - knows about occupations 

b. Average - knows something about occupations 

c. Eelow average - knows very little about occupations 
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9. Are you aware of occupational program and course objectives? 

a. Yes 



b. No 
c • S ome 



10. Do you feel your instructor (s) have clearly explained the objectives and 
goals of your occupational courses? 

a. Yes 

b. No 

11. Do y-L- current occupational courses re^te to your chosen career goal? 
a. Yes 

b. No " 

/ 

c. Somewhat 

12. Rate your program in terms of preparation for an occupation: 
a. High - it will help me find and maintain a job 

_ b. Average - it majr_ help me find and maintain a job 

c. Low it will not help me find and maintain a Job ^ " 

13. Would you recommend the occupational program you are in to a friend? 
a. Yes 

b. No 



14. Do you expect to: (mark only one) 

a. Get a job doing what you are learning? 

ll Get a job similar to the one you are learning? 

c. ConLinuo Ktudyinc about tUc same job at another school after 

graduation? 

. ^- Make little use of what you are learning? 

15. Would you like to change to another occupational program? 
a. Yes 

b. No • ' 51 . ^ 
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16. 



17. 



18. 



Is your preferred program available? 
J a. Yes 

b . No . , 

Is it possible to change programs if you want to? 

a. Yes 

, b. No 

Is it possible to change programs at mid year? 
■ a. Yes 
b • No 
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Appendix C 

Annual Local Evaluation 
for 

Vocational and Technical Education 
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of 
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ANNUAL LOCAL EVALUATION 
OF 

VOCATIONAL AND TECHNICAL EDUCATION 



Procedures and Forms for Conducting an Annual 
Evaluation of Vocational and Technical Education Programs 



February 1976 



Developed by 

Donald E. Elson, Ph.D. 
Division of Vocational and Techni:al Education 
College of Education 
Virginia Polytechnic Institute and State University 
Blacksburg, Virginia 24061 

in cooperation with 



Division of Vocational Education 
State Department of Education 
Richmond, Virginia 23216 



* PREFACE 



V/hat is evaluation? There have been several definitions given but one 
of the better definitions has been stated by Daniel Stuff lebeam: 

Educational evaluation is the process of delineating, obtaining, 
and providing useful information for fudging decision alternatives. 

It should be stressed that evaluation is for ''judging decision alternatives." 
Thus J the purpose of evaluation is not to prove ^ but to improve. 

vnio should evaluate? An evaluation ought to be done by those who are 
responsible for the improvement of the program. Therefore, the teachers, 
supervisors, and administrators of vocational education with the advice 
of advisory committees should be the evaluators of vocational education pro- 
grams . 

The procedures incorporated in, the Annual Local Evaluation were developed 
with the above definition and purpose in mind. Every effort is made to pro- 
vide a systematic, organized approach which will involve all staff members 
in a school division with responsibilities in vocational and technical education. 

Appreciation is expressed to the staff of the Division of Vocational 
Education, State Department of Education, and to Donald E. Elson, assistant 
professor and other faculty members of the College of Education ^ Virginia 
Polytechnic Institute' and State University, who gave their valuable assistance 
in the development of this evaluation procedure. 



George S. Orr, Jr. State Director 
Division of Vocational Education 



EVALUATING VOCATIONAL EDUCATION 



Introduction 

The Suandards of Quality and Objectives for Public Schools in Virginia, 
.1974-76 present guidelines for deveJ.oping the planning capabilities in local 
school divisions. The following quote is taken from Standard No. 8, Five- 
Year School Improvement Plan: 

Each school division shall involve the staff and comnninity in revising 
and extending annually the fdve-year school improvement plan to be sub- 
mitted to and approved by th^i Board of Education on July one, ... (of 
each year)*. This plan shall include: 

a. The objectives of the school division stated in terns of 
student perf omnarice ; 

b. An assessment of the extent to which the objectives are being 
achieved, including follow-up studies of former students; ana 

c. Strategies for achie/ing the objectives of the school division, 
including an organized program for staff improvement. 

A systematic procedure has been developed for evaluating and planning 
local vocational education programs to assist. the localities in meeting this 
standard. Phase One of the system deals with program planning and requiresL- 
that the updated five-year improvement plan for vocational education be 
filed with the Division of Vocational Education on January 15* of each year. 
Phase Two is concerned with the implementation and operation of the planned 
vocational education programs. Data are collected in Phase Two by the 
Vocational Education Reporting System (VERS) to verify the enrollment atA 
operation of the planned programs. Phase Three is the Annual. Local Evaluatioi 
which is an evaluation of the total vocational education program in a school 
division and serves as a basis for the school division's update of the five- 
year plan for vocational education due January 15/each year. 



Annual Local Evaluation 

The Annual Local Evaluation is a systematic procedure for evaluating the 
vocational education programs in the school divisions. It is not an evalua- 
tion of teachers. The emphasis of the Annual Local Evaluation is on the 
total offering of vocational education by the school division as well as the 
various vocational programs. This evaluation procedure considers the three 
major aspects of vocational education — occupational preparation (job entry), 
consumer and homemaking education, and orientation and exploration programs — 
while placing stress on the regular, disadvantaged, and handicapped secondary 
and adult students to be served. 



*The vocational education section is due on the January 15 prececilng the 
July 1 date for the five«year school improvement plan. The Department 
of Education is currently proposing (subject to General Assembly re- 
vision) that the date for submitting the total five year school improve- 
ment plan be changed to January 15, effective in 1977, making all plans 
due on that date, and each January 15 thereafter. 
/ ■ ' ■ / . • 
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The Annual Local Evaluation assists local school divisions in assessing 
the major strengths and major weaknesses of the vocational education programs 
and in making recommendations for program improvement. Since this evaluation 
takes place many months before the Five-Year Improvement Plan is finalized, 
the school division is requested to again state the major strengths as a part 
of the Plan. The major weaknesses should be covered through the objectives 
and strategies in the Plan. 

The Division of Vocational Education suggests the following five major 
goals for vocational education to the local school divisions. The Guidelines 
for Annual Local Evaluation - Part A, Curriculum and Instruction are directly 
related to these goal statements. 

Consistent with their abilities, interests, and education needs: 

1. Youths and adults will acquire the skills and knowledge 
needed for initial and continuing employment or self-employment 
in occupations of their choice and for which there are 
employment opportunities . 

2. Youths and adults will acquire the competencies needed as 
consumers of goods and services, for home and family 
living, and for personal use. 

3. Youths and adults will become aware of employment or 
self-employment opportunities and requirements for use 
in making career choices and in determining their edu- 
cational programs. 

A. Youths and adults will exhibit pride in work well done; 
confidence in ability to perform in the world of work; 
and develop leadership abilities, responsible citizenship, 
and a realistic self-image in relation to work in their 
chosen vocation. 

5. Youths and adults will benefit from programs improved and 
expanded through ancillary activities, including teacher 
education, research, guidance, supervision, planning 
and evaluation. 

Since vocational education is the joint effort of State and local 
educational agencies, a school division can ndopt, rervise, and/or refine 
any or all of these goals and can develop other goals in addition to these 
five goal's. 
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ASSESSMErr OF PROGRESS MADE TOWARD OBJECTTVFS 



schoofdl^irf "^"^ ^ meaningful five year improvement plan by the local 

E^Allr^t I . ^^^"^^^^ assessment beyond the scope of the Annual Local 
tl^TnJ K f" progress made and the remaining local needs in 

terms of each goal adopted for vocational education. 

School divisions are asked to make this assessment of progress twice 
(cove^ln^ "t """^ '^""^ ^^""^^ Evaluation Report is submitted 

aZi^i^5 f^"^"? /r^^ ^'^^^ •^'^^ ^i^^ Year Improvement Plan is 

submitted (covering July to December). 

hp fJ^A^'^l^^ ^""^ submitting this assessment of progress will 

be found on Page 17. Copies of this form were supplied to the school division 
at the txme this booklet was distributed. 

Suggested Vocational Committee Structure 

In .J^V'lf''^ by committees with individual input by teachers are important 
tlslTt .t''''' J^-/-'=°"™--dations to be developed by this procedure are 
school f '=°'->i"-s at the vocational department level within a 

school, at the school level, and at the division level. All vocational 
W^VT V^^^''^''^ a direct input by completing the Guidelines for 
Local Evaluation - P art^,_Curriculu m and Instructi^ . ' S^..H.n^o, t^.t 
stuaents. employers., and other lay persons of the conununity will be active 

strlit^t^ f of the local vocational education programs by 

serving as members of advisory committees. ^sLoma uy 

Since school divisions vary in size and organizational structure, the 
following committee structure for the annual evaluation of the vocational 
education programs xs suggested as a good procedure to consider. School 
divisions will want to vary the procedure to meet their own individual needa. 

Pivis-lon Vocational E d ucation Committp a 

Suggested Membership: 

Director of Vocational Education for school division (chairman) 
One teacher from each vocational service 

One coordinator or supervisor from each vocational service 
One member of the Planning Council 
Supervisor of guidance for school division 

Chairman of the Division Vocational Education Advisory Committee 

Responsibilities: 

Receive recommendations for improvement of the vocational education 

programs from the School Vocational Education Committees. 
Study these recommendations, analyze additional data as required. 

and evaluate the total vocational program. 
Make final set of recommendations for vocational education In the 
u'^fi^u Division Superintendent. F^nal recommendations 

should be reviewed with the Vocational Education Advisory Committee. 
Update, annually, the five-year plan for vocational education. 
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Division Advisory Cotmnlttee 



Suggested Membership: 

General Advisory Committee for Vocational Education plus the 
following if not presently on the coinmittee: 

One employed former student from each vocational service 
One currently enrolled studeni: from each vocational service 

Responsibilities : 

Assist and advise the Division Vocational Education Committee 

School Vocational Education Committee 

A separate committee is needed for each school offering Vocational programs 
in the division. This committee is not necessary in divisions having only 
one high school. 

Suggested Membership: 

Head teacher from each vocational department in school (designate one aa 
chairman) 

(If school is a Vocational Center, the principal should be chairman) 

Coordinator of guidance in school. j 

One member of Division Vocational Educa*'ion Committee 

Responsibilities : 

Receive recommendations from the Department Committees. Study the 
recommendations , analyse additional data as required, and evaluate 
total vocational program in school using Guidelines for Annual Local 
Evaluation - Part B , In schools where use of the Department Committee 
is not feasible, this committee will assume the duties of the Depart- 
ment Committee (refer to section on Department Committees), 
After review by school principal, make final set of recommendations for 
vocational education in the school to the Division Vocational Education 
Committee using Guidelines for Annual Local Evaluation - Part B , 

Department Committees 

A separate committee may be established for each vocational department in 
area vocational centers and comprehensive high schools. The School Vocational 
Education Coimnittee may assume the duties of this committee in small schools 
where such a committee is not feasible. 

Suggested Membership: 

Supervisor and/or head teacher of department in school (chairman) 
All^ teachers in department 

Responsibilities : 

Analyze needed data and the Guidelines for Annual Local Evaluation - 
Part A which were completed by each teacher in the department. 

Develop set of recommendations for the department to be given to the 
School Vocational Education Committee using Guidellnee for Annual 
Local Evaluation - Part B. 




Data Requirements fnr Tnr^T R.x^7.,.t..r^ ^ Planning 

Sound evaluation and plantiing of vocational offerings which are relevant 
to the needs of students and to employment opportunities requira a variety of 
data. The followi.ng types of data should be thoroughly studied during the 
process of evaluating the vocational programs. 
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1. Follow-up of former students by vocational servic 

2. Description of school population (see suggested catagories below) 



Description of School Population 
A. 



19 7A* 



Age* 

(1) 1-5 

(2) 6-15 

(3) 16-19 

(4) Adult 



B. Sex* 

(1) Male 

(2) Female 

C« Ethnic Groups* 

(1) Negro or Black 

(2) White 

(3) Other 

D. Disadvantaged 

(1) Academic 

(2) Economic 

(3) Cultural 

E. Handicapped*** 

(1) Deaf 

(2) Blind 

(3) Speech defect 

/4) Crippling condition 

(5) Convulsive seizure 

(6) Mentally retarded 

(7) Emotionally distrubed 



Present** 



Proj ected 



1 year 5 years 



*Data available from Virginia School Census - 1974 
**Present actual data or projected data from past data 
***Survey made locally for Special Education 
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3. VERS data applicable to local school division 

4. Student needs and interest in vocational education* 

5. Attitudinal data from students, parents, and employers 

6. Manpower data for area — present and projected 

7. Present philosophy and objectives of the Division School Board 
pertaining to vocational education. 

4 

Most of the above data will be available through the principal's office 
since the five-year school improvement plan requires these data. 



*Vocational Education Student Demand Projection System (a description of 
each vocational course available in Virginia and a system to use in detennln-' 
ing student interest) is available from the State Division of Vocational 
Education. 
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GUIDELINES FOR ANNUAL LOCAL EVALUATION 



Summary of Instructions 

The forms, Guidelines for Annual L ocal Evaluation - P»rr A . Curriculum 
and Instructi on and Part B, Summarization , nr. ir.rl .r^.^' aTT^- ^^^^^^;^^^ 

is to be completed by each vocational teacher. 

|art__|^ls ^o be completed by the Department Committees, the School Vocational 
Education Committees, and the Division Vocational Education C^Ltee 

Only one evaluation summary report of the school division (Guidelines for 
Annual Local Evaluation - Part B ) will be sent to the DlrecI^ Dlvlslon o f 
Vocational Education, State Department of Education, by July 1. The purpose 

. t T^f/? '° indicate to the Division of Vocational Education that 
thP fJ^r^ divisions are rollowing an organized approach to evaluation and 

frnrrr"" P^°Sram improvement plan reflects the recommendations result- 

SLfwH .r^^"^'^"""- '^^^ ^^P"^'^ ""^^^ the Division of Voca- 

tional Education to assist the local school divisions in program improvement. 



Part A — Curriculum and Instruction 
Detailed Instruct ions 



, gHi.delines for Annual Local Evaluati on - Part A is to be used by the 

individual teachers to evaluate their programs. Each vocational teacher in 
±he school division should complete this form and submit a set of recommen- 
datxons for his or her prog-am to the most specialized committee used for 
evaluating vocational education in the school division. Individual ratings 
are to go no further than this committee. It is Important to remember that 
this is an evaluati.on of the program and not an evaluation of teachers. 

One original copy of the form is Included in this booklet and a second 
copy will be provided separately. Complete both copies. You are to keep 
the copy Included in the booklet on file so that you may review the ratlngB 
wltti your administrator and supervisory personnel when appropriate. The 
separate copy is to be submitted to the Department Committee or School 
Committee. 

The Guidelines have been organized into four sections. Section I in- 
cludes statements related to Major Goals 1 and 2. Sections II, HI. and IV 
relate to Major Goala 3, 4, and 5, respectively. 
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Part A - 



— Curriculum and Instruction (Continued) 



1. Work with one guideline at a time. 

A. Study each guideline and make notes as to what evidence is available 
or needed to make an evaluation and to substantiate that evaluation. 

B. Collect and analyze needed data (share data to avoid duplication of 
effort). 

C. Assign each guideline an evaluative rating using the following code: 

M » Major improvement needed - critical weakness or inadequacy 

exists in meeting the minimum standard for the guideline. Use 
this rating if a program or service is needed but i^ not being 
provided by your department, 

I « Improvement needed - with minor changes the program could be 
improved to meet the minimum standard for the guideline. 

S =5 Program meets the minimum standard for the guideline, 

E » Program exceeds the minimum standard for the guideline. 
NA « Not applicable. Use only where the purposes of the program 
being evaluated differ from the guideline. Do not use this 
rating if a program or service is needed but is not provided 
by your department, 

2. The ratings are not to be summarized; they are to be used to direct your 
thinking toward listing: (1) the major strengths and the major weaknesses 
of your program by Section and (2) your recommendations for program im- 
provement by Section, 

3. Develop a set of recommendations using the Guidelines, the listing of 
the strengths and weaknesses, and other evaluative data for each Section 
of the Guidelines. 

Recommendations for improvement of the vocational education program should 
originate with the vocational teachers in a vocational department. It 
will be helpful if information concerning student needs and employment 
demands is available to vocational teachers. 
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GUIDELINES FOR ANNUAL LOCAL EVALUATION 
par: a Curriculum and Instruction 



Division: 
School: 



w tf Rating Form 

■ aduu'"I '° ^" ^^^^ -"-1 P"e"-= - well « 



adult programs 



I. ACQUISITION OF SKILLS AND KNOWLEDGE NEEDED FOR INITIAL AND rONTTNlTTMP 
mPLOYMENT- OR SELF-EMPLOYMENT AND COMPETENCIES NeSS^AS^oSsSe^ OF 
GOODS AND SERVICES. FOR HOME AND FAMILY LIVING. aS^OR pSsoSSl Sse! 



The objectives of the program are stated in terms which 
are measurable. i-ci.uu» wnicn 



Ratings* 



2. 



4. 



The program is meecing the needs of those in the following 
groups who are interested in and need such training: 

A. disadvantaged youth 

B. disadvantaged adults ^'^ 

C. handicapped youth 

D. handicapped adults ^ 

E. secondary youth in regular programs g 

F. adults in regular programs J 

« 

3. At least seventy-five percent of the students enrolling in 

the program continue through to completion. 3, 

Between seventy-five and ninety percent of the students 
completing the program or leaving school prior to completion 
w:Lth a marketable! skill and available for employment^f ind 
employment in the field for which trained or closely related 

4. 

students preparing for direct entry into an occupation 
or vocation exhibit a mastery of: 

A. required knowledge and skills c . 

B. necessary connnunication skills g* - 

C. necessary computational skills q'- 

D. competencies needed as consumers of goods and services D.*" 

Measurable performance objectives based on the require 
ot the occupation or vocation are used in all courses. 



5. 



6. 



ements 



6. 



M = major improvement needed; I - improvement needed; S - program meeta 
minimum standard for guideline; E » program exceeds l■h»'"m^n?™.J« T ^ ! 
for the guideline; NA - not applicable? standard 
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GUIDELINES FOR ANNUAL LOCAL EVALUATION (Continued) 



Ratings* 



7. Practices and situations found in business pnd industiTr 

are replicated or simulated in the classroom and laboratory. 7.^ 

8. Individualized instruction is used extensively. 8.^ 

9. Facilities and resources outside the school environment are 
used when appropriate to enrich the learning experience. 9._ 

10. Cooperative occupational experience under the supervision 

of the instructor is available to students. 10» 

11. Senior intensified programs are available for those students 
vho at the end of their junior year or beginning of their 
senior year find that they need special training before they 
can enter the labor market. (Applicable in some but not all 
school divisions.) 11», 



12. Various ability levels and learning speeds may be 
accommodated in the curriculum. 12. _ 

13. Time is allowed for students to acquire, practice, and 
apply manipulative skills, technical knowledge, and related 
subject matter essential to qualify them for employment or 
homeraaking. 13*_ 

14. Students on cooperative occupational experience and their 
employers are visited regularly by the instructors who 
have time assigned in their school schedule for this 
activity. 1^-. 

15. Instructors assist students in obtaining part-time eniploy- 

ment to improve skills and/or remain in school. 15. _ 

16. Instructors assist students . (secondary and adult) to find 
full-time employment after completing program. 16. _ 

17. Equipment, materials and facilities are available to support 

the multi-media approach to instruction. 17.^ 

18. Instructiotial materials are up-to-date and are on the level 
of the students. - 

19. Class size does not exceed recommended maximum enrollrocntfl. 19. _ 

20. The number of students in a class does not exceed the nvMnber 

of complete work stations available. 20._ 

21. All tools, equipment, and supplies meet the standards of — 
and are comparable to those used in the occupation or 
vocation, 21. _ 



*M a major improvement needed; I, « Improvement needed; • program meets 
minimum standard for guidelinesT ^ ■ program exceeds the minimum standard 
for the guideline; ^ « not applicable. 



GUIDELINES FOR ANNUAL LOCAL EVALUATION (Continued) R^^ln b* 

22. All Instructional facilities are of adequate size to 

provide for safe, orderly, and effective instruction. 22. 



II. PROGRAM CHOICES. CAREER CHOICES AND OPPORTUNITIES FOR EMPLOYMENT 

23. The stated goals and objec.-:ives of each vocational course are 
made known to the students before the time of enrollinent . 

^iinn"f"'! ^^""^ ^" opportunity to select and to 

enroll in the program and/or courses of their choices. 

25. Students are provided information with which they may 
confirm or modify their occupational choice early in the 
program. 

26. Students are provided with career counseling activities 
tnat lead to career decision making. 



23. _ 

24. _ 

26. 



III. WORK ETHICS, LEADHISHIP ABILITIES AND POSITIVE SELF-IMAGE 

27. The curriculum of programs preparing students for direct 

entry into an occupation or vocation is designed to develop: 

A. proper work habits and attitudes 27 A 

B. pride in workmanship ^ 

C. proper personal dress, grooming habits, and decorum 

D. understanding of appropriate employer-employee 
relationships. 

E. understanding of appropriate employee-employee 
relationships. 

E. knowledge of personal and business ethics F 

G. understanding of appropriate public relations. 

H. habits of good health and safety practices. 

28. Vocational Education organizations for both youth and/or 
adults are an integral part of the curriculum. 



B. 
E. 



H.' 



28. 



IV. 

29. 



ANCILLARY ACTIVITIES: RESEARCH. INSTRUCTIONAL IMPROVEMENT. ADVISORY COMMITTEES 

Advisory Committees or community groups assist in developing 

and soipport the total plan for the preparation of students 

in the occupation (s) or vocation(s) being taught. 29 



30. New instructional methods are tried in an effort to 

increase the efficiency of learning. 3q^ 



*^ - major improvement needed; I - improvement needed; S - program meets 
minimum standard for guideline; E - program exceeds the-mlntouTstand^rJ 
for the guideline; NA - not applicable. »«.««««ira 
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GUIDELINES FOR ANNUAL LOCAL EVALUATION (Continued) Ratings* 

^ 31. The following factors provide a guide to the relevancy and 
extent to which the objectives of the program are being met: 



A. 


Former students express ^ high degree of satisfaction 






with the program. 


31. A. 


B. 


Former students e>q^ress a high degree of satisfaction 






w±zh their present jab. 


B. 


C. 


Eir^. yers express a "rj.gh degree of satisfaction with 






former students in their employ. 


C. 


D. 


Studenis have positive attitudes toward the program. 


D. 


E. 


Parents have positive attitudes toward the program. 


E. 


F. 


Employers have positive attitudes toward the program. 


F. 


G. 


School administrators have positive attitudes toward the 






program. 


G. 



The above ratings were based on: 1. actual studies 

(Check those which apply) 2. informal observations 

32. Research or development projects have been undertaken to 
improve : 



A. program offerings 32. A. 

B. course content B." 

C. program outcomes C. ~ 

D. data base for evaluation D» 

FOR^^AT FOR REPORTING STRENGTHS, WEAKNESSES, AND RECOMMENDATIONS 

Follow the format shown below in submitting the report on separate sheet (s) of 
paper and attach to this form. 

List major strengths by Sections ; Use items rated as "E" as guides, but do not 
limit the list to those items'. 

Section I: Skills, Knowledge and Competencies 
Section II: Choices and Employment Opportunities 
Section III: Work Ethics, Leadership Abilities and Self-image. 
Section IV: Ancillary Activities 
List major weaknesses by Sections : Use items rated "M" or "I" as guides, but 
do not limit the list to those items. 

4 

/ 

Skills, Knowledge and Competencies 
Choices and Employment Opportunities " 
Work Ethics, Leadership Abilities and Self-image 
Ancillary Activities 

R.ecommendations for Improvement by Sections: 



Section I 
Section II 
Section III 
Section IV 



Section I: Skills, Knowledge and Competencies 

Section H: Choices and Emplojnnent Opportunities 

Section III: Work Ethics, Leadership Abilities and Self-image 

Section IV: ^ Ancillary Activities 

a 
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